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Errata 


In the original version of this report, there was an omission with respect to the search strategy. 
Specifically, following the reported primary search conducted on June16, 2019, that included 
studies published between February 12, 2009, and June 16, 2019, we conducted a “gap search” 
on August 20, 2019, which was not reported in the original version of the report. No additional 
included studies were identified from this gap search. We have updated the search strategies 
portion of the Methods sections of the abstract, evidence summary, and main report to reflect the 
gap search and updated the Results section of the main report to indicate that no new included 
studies were identified. 
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Preface 


Recognized for excellence in conducting comprehensive systematic reviews, the Agency for 
Healthcare Research and Quality (AHRQ) Evidence-based Practice Center (EPC) program is 
expanding its portfolio to include rapid evidence products. The program has begun to develop 
a range of rapid evidence products to assist end-users in making specific decisions in a limited 
timeframe. 


In 2014, AHRQ EPCs produced a taxonomy of rapid evidence products produced by leading 
organizations around the world.'!* This taxonomy now informs the development of rapid 
evidence products. Based on levels of synthesis, the report classified products as evidence 
inventories, rapid responses, and rapid reviews. On one end of the spectrum, evidence 
inventories offer an assessment of the quantity and type of evidence without presenting results. 
On the other end, rapid reviews adapt and streamline traditional systematic review methods to 
provide a limited evidence synthesis. Rapid responses fall between the two; through examination 
of the literature but no formal evidence synthesis or conclusion, rapid responses aim to offer the 
end-user a solution to a targeted problem based on the best available evidence. 


To shorten timelines, reviewers must make strategic choices about which processes to abridge. 
Common adaptations to provide rapid evidence include: narrowly focusing questions, limiting 
the number of databases searched and/or modifying search strategies, using a single reviewer 
and/or abstractor with a second to provide verification, and restricting to studies published in the 
English language. However, the adaptations made for expediency may limit the certainty and 
generalizability of the findings from the review, particularly in areas with a large literature base. 
Transparent reporting of the methods used, the resulting limitations of the evidence synthesis, 
and the strength of evidence of included studies is extremely important. While tradeoffs will 
likely differ for each topic, they are described so readers can adjudicate the limitations of the 
findings and conclusions of the review. 


While rapid evidence products are often sufficient for decision making on their own, at other 
times they can uncover a large, complex literature base that encourages end-users to seek a full 
review. Rapid evidence products can provide a map of the evidence and assist decisionmakers in 
targeting resources to areas of highest interest and greatest potential value. 


AHRQ expects that these rapid evidence products will be helpful to health plans, providers, 
purchasers, government programs, and the health care system as a whole. Transparency and 
stakeholder input are essential to the Effective Health Care Program. 


If you have comments on this report, they may be sent by mail to the Task Order Officer named 
below at: Agency for Healthcare Research and Quality, 5600 Fishers Lane, Rockville, MD 
20857, or by email to epc@ahrq.hhs. gov. 


Gopal Khanna, M.B.A. Arlene Bierman, M.D., M.S. 


Director Director 
Agency for Healthcare Research and Quality Center for Evidence and Practice 
Improvement 
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Retention Strategies for Medications for Addiction 
Treatment in Adults With Opioid Use Disorder: A 
Rapid Evidence Review 


Structured Abstract 


Aims. American deaths from opioid overdose now approach 50,000 annually. While evidence 
shows that medications for addiction treatment (MAT) save lives, retaining patients in MAT 
programs is challenging. The U.S. Agency for Healthcare Research and Quality, on behalf of the 
U.S. Department of Health and Human Services, commissioned a rapid evidence review on the 
effectiveness of interventions to promote a broader understanding of the published literature on 
MAT retention among adults with opioid use disorder (OUD). 


Methods. We searched MEDLINE and the Cochrane Library from February 12, 2009, through 
August 20, 2019, for systematic reviews (SRs) and randomized controlled trials (RCTs). We 
summarized evidence for six retention intervention types: care settings/services/logistical 
support, contingency management, health information technology (IT), extended-release (XR) 
medication-based treatment, psychosocial support, and financial support. Our primary outcome 
was retention, defined as continued medication engagement for at least 3 months after MAT 
initiation. Secondary outcomes included mortality and harms. 


Findings. Key findings from 2 SRs and 39 primary studies include: 

e Most studies of MAT for OUD do not focus on retention as the primary outcome, 
are small (e.g., one to two trials per intervention), and have design flaws. 

e Care setting interventions that initiated MAT in soon-to-be-released incarcerated 
patients improved retention following release. 

e Contingency management improved retention when combined with antagonist MAT, 
but not with agonist forms of MAT. Applicability, however, may be limited due to 
implementation challenges. 

e Preliminary trials suggest that retention in MAT supported with health IT approaches 
may be no worse than in-person approaches. 

e Early studies suggest no difference in retention with XR-buprenorphine in either 
injectable or implant formulations compared with daily buprenorphine. There were 
conflicting results with XR-naltrexone injection compared with daily buprenorphine. 

e The addition of psychosocial interventions did not improve retention; however, many 
studies included some form of counseling in the control groups, potentially obscuring 
evidence of effectiveness. 


Harms were infrequently reported across studies except in studies of XR formulations. 
Similarly, few studies reported whether participant characteristics influenced retention. 


Conclusions. While patients who receive longer-term treatment with MAT have improved 
outcomes, fewer than half of the identified studies measured treatment retention as a primary 
outcome. Limited evidence suggests criminal justice prerelease MAT initiation and the use of 
contingency management for patients on antagonist forms of MAT may aid retention. XR 
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and daily buprenorphine formulations appear to be equivalent for treatment retention and 
comparisons of XR-naltrexone versus daily buprenorphine showed conflicting results. 
Integrating MAT treatment with medical and social services and the use of health IT did not 
change retention. Some studies were conducted outside of the United States, where policies and 
practices differ, focused on highly selected populations and/or conditions that are not fully 
representative of the spectrum of OUD, or were studied in situations that may not be easily 
implemented in real-world conditions. There is a critical need for studies that use standardized 
definitions of retention, include measures of harms as well as benefits, and reflect the full 
spectrum of real-life conditions. 
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Evidence Summary 


Main Points 


e Most studies of medications for addiction treatment (MAT) for opioid-use disorder 
(OUD) do not focus on retention as the primary outcome, are small (e.g., one to two trials 
per intervention), and have design flaws. 

e Care setting interventions that initiated MAT in soon-to-be-released incarcerated 
patients improved retention following release. 

e Contingency management (CM) improved retention when combined with antagonist, 
but not with agonist, forms of MAT. Applicability, however, may be limited due to 
implementation challenges. 

e Preliminary trials suggest that retention in MAT supported with health information 
technology (IT) approaches may be no worse than in-person approaches. 

e Early studies suggest no difference in retention with XR-buprenorphine in either 
injectable or implant formulations compared with daily buprenorphine. There were 
conflicting results with XR-naltrexone injection compared with daily buprenorphine. 


Background and Purpose 


To help inform policy across the Department of Health and Human Services, we conducted 
a rapid evidence review on the effectiveness of interventions to improve MAT retention among 
OUD patients to inform a broader understanding of the published literature. While evidence 
indicates that MAT programs are effective and save lives, retention rates are low. The review 
focused on nonpregnant adults with OUD. 


Methods 


This review followed recommendations from the World Health Organization handbook? 
rapid review methodology and abridged systematic review (SR) processes. Our searches covered 
publication dates from February 12, 2009 to August 20, 2019. We describe our methods in detail 
in the full report. The protocol can be found at: 


[https://effectivehealthcare.ahrq.gov/topics/mat-retention-strategies-oud/rapid-protocol]. 


Results 


Our search retrieved 1,580 unique titles and abstracts from which we reviewed 258 full-text 
articles and included 2 SRs and 39 unique primary studies. A partial summary of findings 
includes the following. 
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Table A. Summary of findings by intervention type 


Intervention 


Comparator | Number of | Number of | Quality of | Summary of 
Studies | Participants | Evidence Retention 
Results 
No MAT 1SR!+ SR: n=834 | SR: good; | Benefit with 
in prison 2 additional | (range: prerelease MAT 
RCTs? 3 32-446) in all studies 
2 RCTs: 1 fair; 
n=228 (15 1 poor 
and 213) 
Specialty 3RCTs*® | n=631 3 fair Inconsistent 
outpatient (range: (2 psychiatric 
setting 94-316) studies, benefit 
in one and no 
difference from 
traditional setting 
in other; 1 study 
in PC, no 
difference from 
traditional 
setting) 
TAU 2RCTs?® |n=429 2 fair ED no worse 
(139 and than traditional 
290) (1 study with no 
difference; 
1 study with 
benefit for 
hospital-initiated 
MAT) 
TAU 4RCTs*"? |n=709 1 good; No difference 
(range: 3 fair 
97-300) 
Noncontingent |3RCTs!*5 |n=140 3 fair Benefit for CM 
access toa (range: in all studies 
reward 35-67) 
Noncontingent |1SR*!©+  |SR:n=1616 | SR: good; | No difference 
access toa 4 additional 
reward RCTs!!:!719 | 4 RCTs: 1 good; 
n=698 3 fair 
(range: 
98-252) 
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Intervention Comparator | Number of | Number of | Quality of | Summary of 
Studies | Participants | Evidence Retention 
Results 
TAU 3 cohort n=3965 3 fair Telehealth no 
studies”°??_ | (range: worse than 
55-3733) in-person 
(2 studies with 
no difference, 
1 study with 
benefit for 
telehealth) 
TAU 3 RCTs? | n=262 2 fair; No difference 
(range: 1 poor 
20-160) 
TAU 1 RCT?6 n=1426 1 fair No difference 
Daily naltrexone | 1 RCT?’ n=60 1 fair Benefit for 
XR injection 
Daily SL- 1 RCT?’ n=428 1 fair No difference 
buprenorphine/ 
naloxone 
Daily SL- 1 RCT”? n=177 1 good No difference 
buprenorphine 
Daily SL- 2 RCTs*:3! | n=729 1 good; Inconsistent 
buprenorphine/ (159 and 1 fair (1 study no 
naloxone 570) difference, 
1 study with 
benefit for SL- 
buprenorphine/ 
naloxone) 
TAU 1 SR*!°+  |SR:n=3124 |SR: good |No difference 
9 additional | (range: in all but 
RCTs? | 14-542) one poor-quality 
study. Many of 
9 RCTs: 2 good; the studies 
n=2483 4 fair; reviewed 
(range: 3 poor included some 
49-653) form of 


counseling in the 
control groups. 


CM=contingency management; IT=information technology; MAT=medications for addiction treatment; RCT=randomized 
controlled trial; SL=sublingual; SR=systematic review; TAU=treatment as usual; XR=extended-release 


*SR applicable to two intervention types 
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Limitations 


We were not able to address every intervention proposed to improve retention in MAT. We 
did not review studies of potentially promising interventions that used non-MAT comparator 
groups. Measures of retention varied amongst studies, making comparisons difficult. 


Implications and Conclusions 


According to the National Academy of Medicine, patients who receive longer-term treatment 
with medication for OUD have better outcomes and are less likely to die from overdose; 
however, fewer than half of the studies identified in this report focused on treatment retention as 
a primary outcome. Initiating MAT in soon-to-be-released criminal justice populations and the 
use of CM for people on antagonist MAT may improve retention, although there may be 
challenges to implementing CM interventions in real-world contexts. MAT treatment programs 
that include the use of health IT may be equally as effective as those delivered using traditional, 
exclusively in-person approaches. Studies of XR versus daily buprenorphine formulations 
showed similar treatment retention, and, while comparisons between XR-naltrexone injection 
and daily buprenorphine yielded inconclusive findings, additional comparative effectiveness 
trials are underway. Future research should focus on treatment retention as a primary outcome, 
use standardized measures of retention, report treatment harms as well as benefits, and consider 
the effects of participant characteristics on the effectiveness of strategies to improve retention 
in MAT. 
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Introduction 


The United States is in the midst of an opioid crisis. In 2017, 2.1 million Americans 12 years 
and older met diagnostic criteria for opioid use disorder (OUD)"! and 47,600 people died from an 
opioid-involved overdose.’ * In addition to overdose deaths, OUD is associated with increased 
rates of comorbid conditions including HIV, hepatitis C, serious bacterial infections, mental 
health disorders, and other substance use disorders (SUDs).” 

There is clear evidence, including a recent report from the National Academies of Science, 
Engineering, and Medicine (NASEM), that medications for addiction treatment (MAT) retention 
improve outcomes.**“* The U.S. Food and Drug Administration (FDA) has approved three 
medications—methadone, buprenorphine, and extended-release (XR)-naltrexone—for treatment 
of OUD.*’ Despite evidence that these medications successfully treat OUD, intermediate and 
long-term retention of patients on MAT remains challenging and highly variable, with retention 
at 3 months ranging from 19 percent to 94 percent.** Potential explanations for the wide variation 
in retention include— 

e Barriers for access to MAT 
Stigma associated with medications 
Costs and logistical issues with obtaining and maintaining medications 
Undertreatment of comorbid psychiatric and medical conditions” 

Fragmented systems of care for people with OUD 

Current SUD financing and coverage policies“ 

Coercion into treatment of people not actively seeking treatment (e.g., drug 
court settings) 

Improving MAT retention can decrease unnecessary deaths.*° >! Successfully addressing 
the opioid crisis will require the American health system to identify, apply, and improve 
interventions that promote MAT retention. 

The U.S. Agency for Healthcare Research and Quality (AHRQ) commissioned this rapid 
review on behalf of the U.S. Department of Health and Human Services (HHS) agencies to 
provide an overview of the published literature to assist the offices in research, practice, and 
policy decision making around strategies to improve MAT retention. HHS partners include the 
Office of the Assistant Secretary for Health, Center for Drug Evaluation and Research at FDA, 
the Office of the Assistant Secretary for Mental Health and Substance Use for the Substance 
Abuse and Mental Health Services Administration (SAMHSA), the Division of Unintentional 
Injury Prevention in the National Center for Injury Prevention and Control at the Centers for 
Disease Control and Prevention, the Office of the Assistant Secretary for Planning and 
Evaluation, the National Institute on Drug Abuse (NIDA) at the National Institutes of Health 
(NIH), and the Health Resources and Services Administration. 


Objective and Guiding Questions 


Our objective was to rapidly identify and summarize latest evidence on interventions to 
improve MAT retention among adults with OUD in order to inform policy priorities and future 
research directions. The following questions guided the literature search and 
inclusion/exclusion criteria: 


Key Question 1: What are the effectiveness and comparative effectiveness of strategies to 
improve retention in MAT among nonpregnant adults with OUD? 


Key Question 2: What are the harms of retention strategies for MAT? 


Key Question 3: Does the effectiveness of the MAT retention strategy vary by participant 
characteristics (e.g., age, gender/sex, socioeconomic status, geographic region, 
polysubstance use)? 


We developed an analytic framework (Figure 1) in consultation with our stakeholders to 
guide our approach. 


Figure 1. Analytic framework for improving retention in MAT for OUD 
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Methods 


This review followed recommendations from the World Health Organization (WHO) 
handbook rapid review methodology” and abridged systematic review (SR) processes in the 
following ways: 

e Introduction. 

e Focused on limited number of topics that were highest priority for partners. 

e Searched a limited number of databases. 

e One reviewer independently reviewed titles, abstracts, and papers for inclusion with 

25 percent independent review by a second reviewer. Disagreements were resolved by 
group consensus. 

e One reviewer abstracted information with second verification. 

e Truncated inclusion criteria (Table 1) to include studies: 

o Published in English language 
o Published in the last 10 years 


o Populations of nonpregnant adults with OUD (excluded studies of HIV, other 
substance use, etc., unless focus was primarily OUD) 
o Focused on retention in MAT (rather than abstinence) 
e Main focus on SRs and comparative randomized controlled trials (RCTs) with active 
controls. 
e We were not able to perform strength-of-evidence assessment. 


Table 1. Inclusion and exclusion criteria 


PICOTS Inclusion and Exclusion Criteria 


Include: Adults over 18 years enrolled in MAT program for OUD, people soon to be released 
from incarceration (e.g., released to the community during the study) 

Exclude: Special populations (e.g., people younger than 18 years of age, pregnant 

people, palliative care/end-of-life, HIV, people incarcerated for the duration of the study) 


Include: Medication formulation (e.g., XR), psychosocial adjuncts (e.g., counseling, CBT, peer 
support, 12-step programs, mindfulness therapy), CM, care settings/logistical support (e.g., MAT 
setting, low-threshold models), financial support (e.g., MAT medication/program reimbursement), 
and health IT 


Include: Comparator groups (e.g., TAU) must also consist of individuals with access to MAT, 
including usual referral and enrollment in outpatient in-person treatment programs, daily MAT 
formulations, XR formulations 


Include* 
Primary: 

Treatment retention 
Secondary: 

Mortality 

Harms 


Include: Retention in MAT was evaluated for at least 3 months. 


Include: Only studies conducted in countries ranked as Very High Human Development by the 
United Nations’ Development Programme’s 2018 Statistical Update “Human Development Indices 
and Indicators.” Outpatient MAT only. 


Include: High-quality SRs, RCTs, observational studies (nonrandomized studies with 
control groups) 


Include: English 


CBT=cognitive behavioral therapy; CM=contingency management; HIV=human immunodeficiency virus; IT=information 
technology; MAT=medications for addiction treatment; OUD=opioid use disorder; PICOTS=population, intervention, 
comparator, outcomes, timing, setting; RCT=randomized controlled trial; SR=systematic review; TAU =treatment as usual; 
XR=extended-release 


* Systematic reviews and primary studies were included only if they report the primary or secondary outcomes of interest. 


We refined the scope of this rapid review in consultation with the partners and a topic expert. 
The protocol was developed based on input from experts and stakeholders and was registered in 
the PROSPERO database (CRD42019134739)°> and publicly posted on the AHRQ Effective 
Health Care Program website.** 

While a rapid review cannot be fully exhaustive or comprehensive, we aimed to provide an 
overview of the literature pertaining to retention strategies for MAT to inform decision making 
during a national epidemic. 


Search Strategies 


We searched OVID MEDLINE and the Cochrane Database of Systematic Reviews from 
February 12, 2009, to June 16, 2019, in consultation with a medical research librarian. We conducted 
an additional gap search through August 20, 2019. For health information technology (IT), we also 
searched the Google Play and Apple stores for commercial apps. See Appendix A for search 
strategies and full list of databases searched. 

Because of the broad scope of retention strategy interventions, we consulted with our 
partners, topic experts, and published and unpublished literature!® “4-°>-°° to develop a 
classification scheme to aid in synthesis. We classified MAT retention interventions in the 
following manner: 

e Care settings, services, and logistical support 

e Contingency management (CM), 


e Health IT 
e XR medication-based treatments 
e Psychosocial support interventions 
e Financial support 
Study Selection 


We included studies that directly compared MAT retention strategies with each other or 
treatment as usual (TAU) if TAU included use of and potential access to MAT. We excluded 
studies that tested interventions that did not use MAT or used controls that did not have access 
to MAT (i.e., no treatment, placebo, abstinence-only, or nonpharmacologic programs). We also 
excluded studies of medications that are not currently FDA approved. We defined retention as 
continued treatment or medication engagement for at least 3 months. In the absence of 
established definitions of treatment retention for MAT, we considered 3 months as the minimum 
clinically relevant time interval to assess retention. We were purposefully inclusive of a wide 
range of study definitions of retention (e.g., retention defined by self-report, medication 
prescribing, or visits to clinics to receive supportive treatment). In many cases, retention was not 
clearly defined, and we could not determine the degree to which patients were adherent to MAT, 
to adjunct services, or abstained from illicit substances. Participants were still considered 
retained in MAT if they continued to use illicit opioids or missed MAT appointments/medication 
dosages. We did not equate study retention with treatment retention. 

When possible, we focused on SRs and on RCTs published subsequent to SRs. Systematic 
reviews were included if they addressed MAT retention, searched at least two databases, 
performed quality assessment of individual studies, and were current (within 10 years of the date 
of the search). If the SR identified relevant studies but did not provide a synthesis specific to 
retention, we used the SR to identify RCTs. In cases where there were no/few identified RCTs, 
we included observational studies. 


Quality Appraisal 


SRs were considered good quality and were included if they met four basic criteria: searched 
more than two databases, performed quality assessment, used predetermined inclusion/exclusion 
criteria, and described the search strategy used. To balance efficiency, rigor, and inclusivity, we 
focused on these four critical features common to quality assessment tools for SRs. For RCTs 
and observational studies, we conducted dual independent review of study quality using criteria 
developed by the U.S. Preventive Services Task Force.°’ We did not downgrade studies with 


high attrition in our quality ratings, because it was related to our primary outcome. We did 
not exclude studies on the basis of study quality; rather, we used study quality to guide our 
interpretation of results and identify areas for improvement in future research. 

To assess the strength of a body of evidence, we relied on published SRs when we could, 
which meant that assessment tools could differ across intervention sections (e.g., in sections that 
had SRs as well as individual studies, the SR may have used a different tool from the one we 
used for individual studies). Also, given the rapid nature of this review, we did not conduct 
quantitative analyses, which are commonly used to assess precision in formal strength of 
evidence assessments. 


Data Collection and Synthesis 


A team member abstracted details related to study design, setting, population, intervention 
and followup, outcomes, and harms. We reported retention outcomes for each included study, 
using intention-to-treat (ITT) analysis; if studies did not report ITT, we calculated this if data 
were available. We then assessed overall effectiveness for each intervention with a particular 
focus on the degree to which the literature reflects real-world clinical circumstances. Through 
iterative discussions with topic experts and SR experts, the study team discussed methodological 
weaknesses of the body of literature as well as individual studies and determined which studies 
provided the most reliable evidence. Qualitative synthesis placed emphasis on those studies 
deemed by the study team to be most reliable and of higher quality. 


Results 


Our search retrieved 1,580 unique titles and abstracts from which we reviewed 258 full- 
text articles for eligibility and included 2 SRs and 39 unique primary studies. No included 
studies were identified in the gap search (Figure 2). MAT retention duration ranged from 3 to 
24 months. See Appendix C for quality ratings of all included studies. 


Figure 2. Literature flow diagram 


Financial Search: 709 
Medline search: 709 


Systematic Review Primary Study Search: 757 
Search: 168 e Medline search: 750 ° 


e Medline search: 152 e Other sources: 6 

e Cochrane Database e From topic expert: 1 
search: 12 

e Other sources: 4 


54 duplicates removed 


1,322 titles/abstracts 
excluded for not meeting 
PICOTS criteria 


1,580 study 
titles/abstracts reviewed 


258 full-text articles 


assessed for relevance : 
Full-text articles 


excluded: 217 
Population not 
of interest: 8 
Intervention not 
of interest: 99 
Comparator not 
of interest: 6 
Outcome not 
of interest: 12 
Duration of MAT 
less than 
3 months: 1 
Study design not 
of interest: 71 
Country not of 


41 included reports (2 SRs, 39 primary studies) 
e Care Settings, services, and support: 
1 SR, 11 primary studies (1 also in 


Contingency Management) 
Contingency Management: 1 SR (also 
in Psychosocial), 8 primary studies (1 
also in Care Settings) 

Health IT: 7 primary studies 
Extended-Release Medication: 

5 primary studies 

Psychosocial: 1 SR (also in 
Contingency Management), 9 primary 
studies 
Financial: 0 studies 


interest: 1 

Study date not 

of interest: 1 

Lack of quality 
assessment: 3 
Does not meet SR 
criteria: 2 

Included in an 
included SR: 7 
Other: 6 


Care Settings, Services, and Logistical Support 


We defined care settings and services as interventions that provide MAT in alternative 
settings or integrated models, compared with TAU conditions that offered MAT alone through 
specialty treatment programs. We defined logistical support as interventions that changed 
the process of MAT initiation and maintenance as compared with TAU, or interventions that 
provided MAT in conjunction with logistical supports, such as housing with health and social 
services assistance. We used an existing framework* to further categorize care setting 
interventions into the following: 

e Interventions that initiate MAT for soon-to-be-released incarcerated populations (1 SR of 

21 studies,! and 2 additional RCTs” *) 

e Integration of MAT with psychiatric or primary care services (PC) (three RCTs 

e Integration of MAT in emergency department (ED)/hospital settings (two RCTs”) 

We identified one good quality SR! and 11 primary studies (one good quality;? 
nine fair;>* !°!* and one poor’) that investigated care setting/logistical support 
interventions.*”?!? Most were downgraded for unblinded outcome assessment or high rates 
of crossover. 
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Key Question 1: Effectiveness and Comparative Effectiveness of 
MAT Retention Strategies 


Table 2 provides a summary of findings across care settings/logistical support, and 
Appendix B Table 1 and Appendix C Table | provide details for included studies. 


Table 2. Summary of findings for care settings / services / logistical support 


Care Setting Intervention Studies, Quality Results 
n 
MAT for soon-to-be-released 1 SR of 21 studies’ Higher retention 
incarcerated populations 2 additional studies? $ (1 fair, 
1 poor quality) 
n=228 
Psychiatric or PC service 3 studies*® (all fair quality) Inconsistent (2 studies, benefit in one and 
integration n=631 no difference from traditional setting in other; 
1 study in PC, no difference from traditional 
setting) 
ED / hospital setting 2 studies” * (both fair quality) | ED no worse than traditional setting (1 higher 
n=429 retention, 1 no difference) 
Logistical support 4 studies*? (1 good, 3 fair No difference 
quality) 
n=718 


ED=emergency department; MAT=medications for addiction treatment; PC=primary care; SR=systematic review 


Care Setting: MAT for Soon-To-Be-Released 
Incarcerated Populations 

A good quality SR! of 21 studies (6 RCTs and 15 observational) and 2 additional RCTs” + 
examined interventions that initiate MAT in soon-to-be-released incarcerated OUD patients. The 
SR found that initiating MAT in this population was associated with high levels of postrelease 


treatment entry and retention compared with TAU controls who did not initiate MAT prior to 
release (retention rates 50% [range 27-75%] vs. 5% [range 0-9%]).' The review assessed quality 


using Cochrane guidelines, with the majority of studies of fair quality (nine), followed by good 
and inadequate (six each). Two additional RCTs conducted in the United States (one poor’ and 
one fair quality) similarly reported improved retention with initiation of MAT in 
soon-to-be-released incarcerated populations. One was a small 6-month study (n=15) that 
randomized inmates to be offered the first monthly dose of XR injectable naltrexone prior to 
being released from prison compared with TAU and found that the intervention group had higher 
retention by multiple measures (mean number of injections received 2.8 (standard deviation 
(SD)=1.9) vs. 1.3 (SD=1.9; 22% (2/9)) received all 6 monthly injections vs. 0% (0/6); and 46% 
vs. 22% treatment appointments attended, p-values not reported (NR)).” The second study was a 
2x2 factorial design (n=213) that assessed the effect of prerelease buprenorphine treatment 
compared with an office-based buprenorphine or traditional outpatient treatment program and 
found that the prerelease buprenorphine group had higher mean number of days retained in 
treatment at 12 months (65.9 days (standard error (SE) 12.2) vs. 21.8 (SE 7.6), p=0.005).? 
Together, these studies suggest that initiating MAT prior to release from incarceration improves 
retention. 


Care Setting: Integration of MAT With Psychiatric and Primary 
Care Services 


Three fair-quality RCTs provide conflicting evidence on the effectiveness of integrating 
psychiatric or PC interventions on MAT retention.*® All were small studies (n range = 94-316): 
two of three involved integrating psychiatric care with substance use treatment (one methadone 
and one buprenorphine) and were conducted in the United States, and one was a study from 
France that integrated methadone treatment with PC. The largest study is a U.S. study offering 
psychiatric services on site at a traditional methadone treatment program compared with separate 
nonintegrated psychiatric and substance use care. While initiation and total days of psychiatric 
care were improved for onsite integrated services, there was no statistically significant difference 
in MAT retention at 12 months (n=316, 41% vs. 41%, p=0.96).* 

The second study integrating psychiatric care (n=94) was a fair-quality three-arm U.S. trial 
that offered buprenorphine treatment in psychiatric clinics, a manually matrixed psychosocial 
model with cognitive behavioral therapy (CBT) in private clinics, and a specialized opioid 
treatment program. This study reported a significant association between treatment site and 
retention at 20 weeks (p=0.05), with 33.3 percent retained in the psychiatric setting, 51.5 percent 
retained in the psychosocial model, and 21.4 percent retained in the specialized outpatient 
treatment (retention).° The one study in which treatment was integrated into PC was a 
noninferiority trial conducted across 10 sites in France (n=195) that compared methadone 
treatment integrated with PC with specialized outpatient methadone treatment programs and 
found no statistically significant differences at 12 months (88% retention in PC vs. 69% in urgent 
care, p=0.13).° 


Care Setting: MAT in ED/Hospital Settings 


We identified two RCTs of fair quality that examined retention after introducing MAT in 
ED or hospital settings.” * One study enrolled patients at a U.S. safety-net hospital (n=139) to 
initiation of buprenorphine with linkage to outpatient treatment within 7 days of discharge 
compared with TAU (medically supervised withdrawal and community referral to treatment). 
Patients in the hospital-initiated group reported a 2.4 times higher rate of buprenorphine or 


methadone use over 6 months (incidence rate ratio (IRR), 2.44, 95% confidence interval [CI], 
1.99 to 3.36). At 6-month followup, 12 (16.7%) patients randomized to linkage compared with 
two (3.0%) to TAU had continued on MAT (p=0.007).’ The second study was a followup study 
conducted in the United States of a 3-arm RCT (n=290) of adults with OUD randomized to either 
1) ED-initiated buprenorphine with linkage to PC within 72 hours, 2) referral to treatment 
(TAU), or 3) brief intervention in ED, and assessed retention at 6 and 12 months, defined by 
self-reported engagement in formal addiction treatment, and found no differences in retention 

at 6 (53% vs. 60% vs. 51%, p=0.546) or 12 months (49% vs. 49% vs. 63%, p=0.136).° 


Logistical Support 


As a whole, studies of logistical interventions enrolled patients with higher addiction severity 
and did not show improved MAT retention compared with a standard treatment setting. We 
identified one good- and three fair-quality RCTs (total n=709) that tested changes in MAT 
prescribing procedures, such as lessened MAT participation requirements (“low-threshold”) or 
expedited initiation onto MAT treatment (“Script in a Day’), or the provision of housing with 
social/medical supports, compared with TAU.” A U.S. trial of a low-threshold, 
patient-centered methadone intervention (optional counseling, modified clinic rules, no discharge 
for administrative violations) compared with TAU found no differences in retention at 12 months 
(n=300, 48.6% vs. 46.3%, p=NR).” Similarly, another trial that involved low-threshold initiation 
intervention that only required once monthly counseling found no statistically significant 
differences in retention at 90 (n=212, 35% vs. 31%, p=not significant (NS)) and 180 days (37% 
vs. 29%, p=NS).!! An innovative intervention offering immediate access to methadone from a 
U.K. syringe exchange followed by transfer to office-based methadone compared with TAU 
similarly found no differences in retention at 3 months (n=100, 51% vs. 47%, p=NR). Finally, a 
trial of a Housing First intervention in which participants in Canada experiencing homelessness 
were assigned to one of three housing with health/social services groups compared with TAU 
(referral to housing assistance programs and outpatient specialty treatment), assessed retention 
using medication possession ratio (MPR) over 2 years and found no differences between groups 
(n=97, MPR 0.52 vs. 0.57, p=0.60).'? (See Appendix B Table 1.) 


Key Question 2: Harms of MAT Retention Strategies 


Most studies of MAT retention strategies did not evaluate possible harms. Only 4 of the 
10 trials of care settings/services/logistical support reported serious harms or adverse events—of 
these, two did not specify in which arm the events occurred. A trial of a patient-centered 
methadone intervention reported 67 non—study-related hospitalizations and 
two non-study-related deaths, one from methadone overdose, out of 149 intervention 
participants. This compares with 59 hospitalizations, 4 non—study-related deaths, and 
2 overdoses out of 151 TAU participants.’ In the study of prerelease MAT with XR-naltrexone, 
six patients in the prerelease MAT arm reported adverse events (two serious, not specified) 
compared with two (none serious) in the control arm.? 


Key Question 3: Participant Characteristics Associated With MAT Retention 


The majority of studies did not examine particular population characteristics to explain 
variation in responses to care settings/services/logistical support. As noted above, patients with 
OUD in criminal justice populations may benefit from prerelease initiation of MAT. The study 


of the prerelease MAT with office-based buprenorphine in a PC setting found no gender 
differences in retention outcomes.* 


Contingency Management 


Table 3 provides a summary of findings across CM interventions, and Appendix B Table 2 
and Appendix C Table 2 provide details for included studies. 


Table 3. Summary of findings for contingency management 


MAT Medication Type Studies, Quality Results 
n 

Opioid receptor 2 RCTs, injectable naltrexone (fair quality)'> 14 Higher retention 
antagonist MAT n=73 

1 RCT, naltrexone (fair quality)'® 

n=67 
Opioid receptor 1 SR, 14 CM studies with methadone, buprenorphine, or LAAM'® No difference 
agonist/partial agonist | n=1616 


MAT 
3 RCTs, methadone (1 good, 2 fair quality)'" 1” 18 
n=562 


1 RCT, methadone or buprenorphine (fair quality)'® 
n=136 

CM=contingency management; LAAM=levo-alpha acetyl methadol; MAT=medications for addiction treatment; 
RCT=randomized controlled trial; SR=systematic review 


Contingency management interventions involve providing a reward contingent upon 
the achievement of specified criteria. While CM is sometimes used in conjunction with other 
psychosocial interventions, we analyzed it separately, similar to the approach used in a prior SR 
on psychosocial interventions!®. 

One good-quality SR,!° and seven RCTs (one with a followup study)!! !3-!5:!7-!9 of CM 
interventions assessed retention outcomes among nonpregnant adults who received MAT for 
OUD. Contingency management improved retention on antagonist MAT, but not for opioid 
agonist MAT (Table 3). Appendix B Table 2 provides study details. Sample sizes per study for 
the seven identified RCTs ranged from 35 to 252 participants and we rated one study as good 
quality,'* and seven fair quality.!!: !3-!>- !7- 19-59 Most were downgraded due to lack of evidence 
of allocation concealment, lack of similarity of groups at baseline, and lack of blinding. 


Key Question 1: Effectiveness and Comparative Effectiveness of MAT 
Retention Strategies 


A 2011 SR of 35 studies (n=4319) that included heterogeneous CM interventions that 
rewarded opioid abstinence in individuals receiving agonist/partial agonist MAT (methadone, 
buprenorphine, or levo-alpha acetyl methadol [LAAM]) found no statistically significant 
difference in retention compared with agonist/partial agonist therapy (methadone, 
buprenorphine, or LAAM) alone (14 trials, n=1616, risk ratio (RR) 1.02[0.96,1.08]).'° The 
evidence included in the SR was assessed with Grading of Recommendations Assessment, 
Development and Evaluation (GRADE) as being high strength of evidence. 

Four of the seven additional trials (of fair to good quality) that we identified also used 
agonist/partial agonist MAT (methadone or buprenorphine) and confirmed findings of the 
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SR.!!!7-!9 The remainder, three fair-quality studies, reported improved retention in MAT.!*"5 
These three studies were conducted at the same site, but with separate populations. They used 
antagonist therapy (naltrexone), had similar criteria for accessing the reward (participants were 
required to take naltrexone that was provided free of charge and in close proximity to access 

to the reward), and provided a similar type of reward (access to a therapeutic workplace where 
participants earned vouchers to exchange for preferred goods and services). The studies differed 
in the type of naltrexone formulation administered (two using monthly XR-naltrexone and one 
using daily naltrexone). Regardless of formulation, retention outcomes were greater in 
contingency participants compared with participants who were permitted access to the workplace 
without contingency: injectable, XR-naltrexone (two studies, n=35, 66% vs. 35% received all 
scheduled injections, p=0.026'?; n=38, 74% vs. 26% received all scheduled injections, 
p=0.004);!* and daily naltrexone (n=67, 54% vs. 16% retention at end of study, p<0.01).!° In an 
additional followup study, the group differences in retention were no longer observed 6 months 
after the intervention ended (n=67, p=0.66).°” 


Key Question 2: Harms of MAT Retention Strategies 


The SR! sought data on adverse events but did not report any, and only one of the 
eight RCTs reported harms. The 1 RCT that reported harms used daily naltrexone and reported 
adverse events in 8 out of 67 participants, 6 of whom were in the contingency group.!* The 
adverse events included one lethal opioid overdose in a contingency group participant that 
occurred a month after study conclusion. Other adverse events included sexual dysfunction, 
abdominal problems, headache, sleep problems, opioid withdrawal, nausea, chills, rapid heart 
rate, and shakiness. 


Key Question 3: Participant Characteristics Associated With MAT Retention 


The identified studies did not assess differential effectiveness of CM on retention by defined 
participant characteristics (e.g., gender/sex, socioeconomic status, etc.). 


Health Information Technology 


We adopted the Office of the National Coordinator for Health IT Playbook definition and 
categorization of health IT that defines the scope of IT to include electronic medical record 
interventions such as prescription drug monitoring, phone apps, e-prescribing, 
telehealth/teleconsult, and computerized decision aids.*° Figure 3 presents an overarching 
framework, adapted from the Health IT Playbook, for the ways in which health IT interventions 
are proposed to increase retention in MAT. 

Seven unique completed studies (three fair-quality RCTs, one poor-quality RCT, and 
three fair-quality cohort studies),”°** © met the inclusion criteria for health IT interventions, 
including an active control involving in-person MAT as a comparator, and MAT retention as an 
outcome. Table 4 provides a summary of findings across health IT interventions and Appendix B 
Table 3 provides details for included studies. 
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Figure 3. Spectrum of IT interventions proposed to increase MAT retention 
Healthcare-based with Fixed Times Patient-based, On-demand 


ePrescribing EHR System Telehealth Computer-based Phone Apps 
Integration Education/Support 


Connecting 
People 
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to 
Provider 


Provider 
to 
Provider 


Wearables, Monitoring 
& Prediction 


Resource Text Messaging 
Locators & Reminders 


Without Studies Published Ongoing Studies 


Situation & 
GPS Monitoring 


Physiological & 
Symptoms 
Monitoring 


Apps=applications; CBT=cognitive behavioral therapy; EHR=electronic health record; GPS=global positioning system 
This figure adapted from the Office of the National Coordinator for Health IT Playbook definition and categorization of 
health IT.*° 


Table 4. Summary of findings for health IT 


Intervention Studies, Quality Results 
n 


0 RCTs; 3 fair-quality cohort | Telehealth no worse than in-person (higher 
studies?°-22 retention in largest study and no difference in 
n=3965 two smaller) 


2 fair-23: 24 and 1 poor-quality | No difference 
RCT?5 
| n=262 


| 4 fair-quality RCT26 No difference 
| n=1426 


None 6 commercially available apps identified 


IT= information technology; RCT= randomized controlled trial 


Key Question 1: Effectiveness and Comparative Effectiveness of 
MAT Retention Strategies 
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Four RCTs (three fair quality’**° and one poor”) and three fair-quality retrospective cohort 
studies*”? assessed IT interventions for MAT retention. No RCT found IT intervention to be 
less effective than in-person approaches. 

The largest RCT (five times the size of the others combined) of fair quality (n=1426) is an 
industry-sponsored study where patients new to buprenorphine treatment were randomized to 
receive in-person buprenorphine MAT (TAU) or buprenorphine MAT plus a Here-To-Help 
(HTH) IT intervention consisting of calls from care coaches and access to online educational 
materials, treatment calendars, and self-reported information from previous participants.”° © At 
12 months, ITT analysis indicated no significant difference between groups (55.0% HTH vs. 
56.1% TAU, p-value=NR). Planned post-hoc analysis revealed that people who completed a 
greater number of intervention calls with coaches had a greater probability of retention in MAT 
(adjusted logistic regression Exp (B)=1.01, p<0.001) and 64 percent of participants in the HTH 
program who completed at least three HTH sessions remained in buprenorphine MAT compared 
with 56 percent in TAU (p<0.025).”° 

Health IT is relatively new to healthcare and not part of the provision of MAT in the 
United States, so it is not known, if offered, the degree to which people would use it. While OUD 
treatment differs widely from the United States, a large retrospective Canadian study (n=3733) 
suggests that up to half of patients might choose health IT as part of their treatment if offered, 
without worsened retention.”° 


Key Question 2: Harms of MAT Retention Strategies 


As a whole, harms were not well reported across health IT studies, with the majority not 
mentioning whether they assessed potential harms. One RCT reported that 12 adverse events 
occurred in a study of 82 participants (15% overall; 17% in intervention group and 12% in 
TAU), but no details were provided about the nature of the events.” 

A small feasibility study that did not report on retention and therefore was not included in our 
review provides helpful detail on some challenges and harms that may be unique to IT.*! These 
issues included difficulties with computers or internet problems, lack of study staff training in 
technical support with patient connectivity, difficulties with compatibility with organizational 
security systems, patient privacy, and loss of clinical care time due to IT issues. 


Key Question 3: Participant Characteristics Associated With MAT Retention 


There is inconclusive information to determine which patients are most likely to benefit from 
IT and which types of IT might be most appropriate for specific patients (e.g., patient-provider 
communication, treatment, and/or counseling, educational support, reminders, monitoring). The 
large retrospective cohort study from Ontario, Canada, found a significant association between 
sex, clinic region (northern vs. southern), age, and peak methadone dose but not for clinic 
rurality.*° Patients who chose treatment delivery via predominantly telemedicine (greater than 
75% of appointments) came from both urban (77%) and rural (23%) populations. Findings from 
a secondary analysis of an RCT that replaced the second half-hour of every in-person counseling 
session with an IT Therapeutic Educational System found that including a Therapeutic 
Educational System as part of care was better for patients who were employed, highly anxious, 
ambivalent about opioid abstinence, and had crack cocaine use in the past 30 days.” 
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Commercially Available Mobile Apps 


Six apps were identified via the Google Play and Apple store (Opioid Addiction Recovery 
Support, Pear Re-SETO, Thrivee, A-CHESS, COR-12, FlexDek: MATList). There were no 
published studies about these apps with regard to OUD treatment. All apps have some 
educational component. Five of six apps contain some feature that allow patients to connect 
with peers, either through interaction in forums, virtual group therapy, or direct contact, and 
allow users to track their progress through treatment. At least two apps (A-CHESS and FlexDek 
MAT) provide patients with resources to identify local Narcotics Anonymous meetings, either 
through direct Global Positioning System (GPS) locating or by acting as a repository for 
schedules. We only identified evidence for the A-CHESS app, which was initially developed 
for alcohol use disorder, but an ongoing RCT is evaluating A-CHESS for OUD. 


Extended-Release Medication-Based Treatment for OUD 


Extended-release is a long-acting form of MAT delivered as either injectable or 
implant-based formulations. The only three XR formulations currently approved by the 
U.S. FDA for the treatment of OUD are a 1-month buprenorphine injection, a 6-month 
buprenorphine implant, and a 1-month naltrexone injection. 

We identified a total of five fair-to-good—quality RCTs”’?! comparing XR formulations 
(naltrexone injection, buprenorphine injection, and buprenorphine implant) head-to-head against 
daily MAT formulations (naltrexone, buprenorphine/naloxone, and buprenorphine). Most were 
downgraded for unblinded treatment or outcome assessment. 

Table 5a provides a summary of treatment retention findings for XR and daily formulations 
for the same drug, while Table 5b summarizes retention findings for XR and daily formulations 
for drugs across different agonist/antagonist categories and formulations (see Appendix B 
Table 4 and Appendix C Table 4 for details). 


Table 5a. Summary for extended-release versus daily MAT formulations within the same 
agonist/antagonist drug categories 


Comparison Studies Results for Extended-Release Study Setting 
Naltrexone 1 study?’, Higher retention Inpatient followed by 
Extended-Release 1-Month | fair quality (57.1% vs. 28.1%, hazard outpatient specialty 
Injection vs. n=60 ratio=2.18, 95% Cl=1.07, 4.43, at | treatment center 
Daily Naltrexone 6 months of treatment) medicine setting 
Buprenorphine 1 study?8, Similar retention Outpatient specialty 
Extended-Release 1-Month | fair quality (56.8% vs. 58.1%, p-value NR, at | treatment center 
Injection vs. Daily SL- n=428 24 weeks) 

Buprenorphine/Naloxone 

Buprenorphine 1 study”®, Similar retention Outpatient specialty 
Extended-Release 6-Month | good quality (93.1% vs. 93.3%, p-value NR, at | treatment center 
Implant vs. Daily n=177 6 months) 


SL-Buprenorphine 
Cl= confidence interval; MAT=medications for addiction treatment; NR=not reported; SL=sublingual 
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Table 5b. Summary for extended-release versus daily MAT formulations across different 
agonist/antagonist categories 


Comparison Studies Results for Extended-Release Study Setting 
Naltrexone 2 studies®° 31, Inconclusive Inpatient followed by 
Extended-Release 1-month | 1 fair, 1 good (n=570, 33.9% vs. 40.0%, outpatient specialty 
Injection vs. Daily SL- quality p-value NR, at 24 weeks) treatment center medicine 
Buprenorphine/Naloxone n=729 setting (larger study); 

(570, 159) (n=159, mean (SD) time 69.3 Outpatient specialty 
(25.9) vs. 63.7 (29.9) days, treatment center 
p-value NR, at 3-months) (small study) 


MAT=medications for addiction treatment; NR=not reported; SL=sublingual 


Key Question 1: Effectiveness and Comparative Effectiveness of 
MAT Retention Strategies 


One fair-quality study (n=60)”’ compared XR-naltrexone monthly injection with daily 
naltrexone. Retention was defined as documented clinical contact at 6 months and favored the 
XR-naltrexone group (57.1% vs. 28.1%, hazard ratio (HR)=2.18, 95% CI=1.07, 4.43). 

Two studies compared XR and daily buprenorphine formulations, though neither assessed 
retention as a primary outcome.** 7? One was a good-quality multisite trial (n=177) that 
randomized participants who were stable on a low dose of daily buprenorphine prior to 
enrollment to a buprenorphine 6-month implant versus daily sublingual (SL)-buprenorphine and 
found no difference in rates of treatment retention at 6 months (93.1% vs. 94.3%, p-value NR).”° 
The other was a larger fair-quality trial (n=428) of a weekly, followed by monthly, 
buprenorphine injection compared with daily SL-buprenorphine/naloxone that enrolled 
treatment-seeking participants and found no difference in retention at 24 weeks (56.8% vs. 
58.1%, p-value NR).78 

Two studies comparing XR-naltrexone injection versus daily SL-buprenorphine/naloxone 
had inconsistent results.*° >! One was a good-quality study conducted in Norway (n=159) that 
recruited patients from outpatient and inpatient settings.*! Treatment retention was defined as 
mean days until dropout from the study medication and did not differ between the two groups 
(mean (SD) days 69.3 (25.9) XR-naltrexone vs. 63.7 (29.9) days SL-buprenorphine/naloxone, 
p-value NR) The other was a fair-quality U.S. study that recruited 570 patients from community 
outpatient treatment programs.*” Retention was defined as percentage of patients receiving MAT 
at 3 months and was lower with XR-naltrexone compared with SL-buprenorphine/naloxone 
using ITT analysis (33.9% vs. 40.0%, p-value NR). 

Our synthesis identified study design issues that may have impacted the retention results, 
particularly for XR-naltrexone formulations. The study that found that XR-naltrexone injection 
improved retention compared with SL-buprenorphine/naloxone randomized only those 
participants who successfully completed medically supervised opioid withdrawal. In contrast, 
the other study that found lower retention with XR-naltrexone randomized patients prior to their 
completion of supervised withdrawal and had high rates of treatment induction failure (72% vs. 
94%, p<.0001) in the XR-naltrexone compared with the SL-buprenorphine/naloxone group; this 
could explain the lower retention rates reported. Restrictive study inclusion criteria that exclude 
participants with alcohol dependence or polysubstance use** *! are also likely to affect 
generalizability of the results. 


Key Question 2: Harms of MAT Retention Strategies 
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Studies of XR formulations reported a variety of adverse events, ranging from serious fatal 
and nonfatal adverse events to adverse events presumed secondary to treatment medication. All 
studies reported nonserious adverse events at XR-naltrexone and XR-buprenorphine injection 
sites. 

Sullivan et al. 2019 (n=60) reported one severe adverse drug-related event when one of 
28 participants developed hives after receiving XR-naltrexone injection and was removed from 
the study.”’ Lee et al. 2018 (n=570) reported a total of 28 overdose events among 
23 participants.*° While these overdose events were not categorized as drug related, 18 (64%) of 
the 28 events were among participants randomized to XR-naltrexone, and included 
eight participants who had failed treatment induction and never received an injection. 

Five overdose events were fatal and included two participants in the XR-naltrexone arm 
and three in the SL-buprenorphine/naloxone arm. 


Key Question 3: Participant Characteristics Associated With MAT Retention 


There is limited information to determine which patients are most likely to benefit from XR 
formulations. None of the studies we reviewed noted differences in participant characteristics 
that predicted retention for XR formulations. 


Psychosocial Support 


We used a prior review'® to define psychosocial support interventions, which include 
psychiatric care, psychotherapy, counseling, and social work services that provide psychological 
support ranging from structured psychotherapies such as CBT and supportive expressive therapy 
to behavioral interventions. We analyzed CM interventions separately above. 

One good-quality SR'° and nine additional RCTs?” (sample size range=49-653) examining 
psychosocial supports for MAT met inclusion criteria; an additional two studies included IT 
interventions and are reviewed in that section.** 7° We rated two studies as good quality*? *°; 
four as fair*>*, and three as poor.*?*4 

Most were downgraded due to unblinded outcome assessment. Table 6 provides a summary 
of findings and Appendix B Table 5 provides study details. Quality ratings for individual studies 
are reported in Appendix C Table 5. 


Table 6. Summary of findings for psychosocial interventions 


Psychosocial Intervention Studies, Quality Results 
n 
Psychosocial interventions: 1 SR of 27 studies, n=3124'® (SR No difference in retention between 

e behavioral (e.g., CBT) rated evidence as high quality psychosocial intervention and 

e psychoanalytic using GRADE) control groups (SR and RCTs) in all 
(e.g., short-term but one poor quality study 
interpersonal therapy) 

e counseling 9 RCTs, n=2483 (3 poor,°24 Many of the studies reviewed 
(e.g., intensive 4 fair,3°36 included some form of counseling 
outpatient counseling) 2 good quality®®: 4°) in the control groups, which may 

e other (e.g., 12-step explain the lack of demonstrated 
facilitation therapy) effectiveness. 


CBT=cognitive behavioral therapy; GRADE=Grading of Recommendations Assessment, Development and Evaluation; 
RCT=randomized controlled trial; SR=systematic review 
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Key Question 1: Effectiveness and Comparative Effectiveness of 
MAT Retention Strategies 


An SR with meta-analysis found that adding structured psychosocial interventions to MAT 
did not improve retention compared with standard MAT (27 studies, n=3124, RR 1.03, 95% CI 
0.98 to 1.07).!° The SR assessed the strength of the body of evidence with GRADE and rated it 
as high quality. Of the nine additional RCTs, eight reported no statistically significant effect of 
psychosocial interventions.***° However, many of the studies reviewed included some form of 
counseling in the control groups, which may explain the lack of effect. One poor-quality study 
reported significantly higher buprenorphine MAT retention in the intervention group, which 
included a Community Reinforcement Approach (CRA) component that makes use of an 
individual’s social networks to encourage adherence to the program compared with CM alone 
(n=170, 80% CRA vs. 64% CM-alone; odds ratio (OR) 2.3, 95%CI 1.15-4.60).°? 


Key Question 2: Harms of MAT Retention Strategies 


The one study in which there was a statistically significant benefit of psychosocial 
intervention did not report any significant harms.** Another study (n=300) reported significant 
potential harm from psychosocial intervention.** In this study, when controlling for number of 
days in treatment, more exposure to counseling was significantly associated with increased 
frequency of heroin use, cocaine use, and criminal activity (all p<0.01). The authors suspected 
that this association was due to confounding by indication as clinicians tended to insist on 
participation in additional services for patients who were not progressing. This same study also 
reported higher self-reported burden on participants and found the intervention group reported 
increased burden compared with the control (p<0.05). Looking across studies, we found 
differences in time commitment between intervention and control conditions in six studies that 
may have affected intervention fidelity, attrition rates, and retention outcomes due to increased 
treatment burden.*” 34: 374° 

Another study (n=542) of pharmacist-delivered motivational interviewing versus normal 
practice for methadone patients found that self-reported physical health was statistically poorer 
for the intervention group; they theorized these results were due to increased awareness of health 
due to increased conversations between participant and pharmacist in the treatment group.** 
Other studies reported adverse events and non—overdose-related deaths that the study authors 
judged to be unrelated to the interventions studied.>> *® 


Key Question 3: Participant Characteristics Associated With MAT Retention 


Few included studies provided information about which patients, if any, are most likely to 
benefit from psychosocial interventions. A study (n=125) of XR-naltrexone coupled with a 
Behavioral Naltrexone Therapy (BNT) intervention compared with XR-naltrexone coupled with 
Compliance Enhancement reported a significant interaction (p=0.03) between condition and 
severity of OUD.** For low-severity patients (less than six bags of heroin per day), retention was 
highest in the BNT group (60% at 6 months). BNT adapted elements of CRA in encouraging 
positive social reinforcement. 


Financial Support 


We defined financial support as individual and system-level interventions to lower financial 
barriers to MAT, ranging from financial subsidies to assist enrollment in MAT programs to 
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expanding MAT coverage by Medicaid and private health plans. We did not identify any SRs or 
RCTs of financial interventions to improve retention in MAT; expanded searches of 
observational studies also did not yield relevant studies. 


Discussion 


Although MAT improves short- and long-term outcomes for people with OUD and reduces 
mortality, various reports estimate that fewer than half are retained in MAT treatment at 
followup.*® Overall, we found few studies evaluating interventions to improve retention in MAT 
and many did not assess retention longer than 3 months. Studies also varied in experimental 
design, measures of retention, and intervention types, making across-study comparisons difficult. 
The majority of the studies were downgraded in quality due to a lack of blinding of outcome 
assessors and high study attrition rates. 


Care Settings/Services/Logistical Support 


Our findings suggest that interventions that introduce MAT to soon-to-be-released 
incarcerated patients are an effective way to improve retention in this high-risk population. 
Given the high proportion of OUD in criminal justice populations and the exponential increase in 
overdose risk within the first few weeks of reentry into the community,°* “ interventions in this 
setting have potential to be high impact. 

We also found that interventions integrating MAT into hospital and emergency settings prior 
to discharge were no worse for retention at 3 months than when MAT is delivered in traditional 
settings, though only two studies were included in our review suggesting additional studies may 
change conclusions. 

Providing healthcare and social services alongside MAT makes intuitive sense to improve 
convenience and provide patient-centered care, and improve retention, particularly in areas 
where there are few specialty treatment programs. However, studies supporting MAT delivery 
in nontraditional settings were small, heterogeneous, or were conducted in non-U.S. settings that 
have different treatment regulations, so applicability to the United States is uncertain.®° Multiple 
well-designed studies are underway, including the Helping to End Addiction Long-term 
(HEAL) Initiative that will test a variety of interventions in multiple settings across the 
States. Study measures will include assessment of retention at 6 months to provide much-needed 
evidence in this area.°© 


Contingency Management 

Our review found that CM interventions may improve retention for patients taking antagonist 
MAT, but not agonist MAT. A prior SR similarly did not identify benefit of these interventions 
with agonist and partial agonist MAT (methadone and buprenorphine).'° Our review included 
studies that used antagonist (naltrexone) MAT. 

The type of MAT may be important in CM intervention effectiveness. Introduction of 
an outside reward may be of limited value in agonist and partial-agonist MAT, in which the 
medication provides some self-reinforcing effects (i.e., relief from withdrawal symptoms), 
compared with antagonist MAT, in which the medication does not provide any desired drug 
effects that may promote continued MAT use.°® This could partially explain the positive effects 
on retention in all studies with a CM intervention for naltrexone treatment, and the noneffect on 
retention in studies that employed methadone or buprenorphine MAT. 
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Additionally, features of the CM intervention used in the studies that demonstrated an effect 
on retention may have contributed to the effectiveness of the intervention, including the type of 
response required to meet the contingency and the salience of the reward.” In the studies that 
reported improved retention, the behavior rewarded was adherence to prescribed MAT 
medication dosages, whereas, in the studies without effects, the behavior that was rewarded was 
primarily drug use abstinence. Further, the reward, access to a workplace where participants 
could gain work skills and earn vouchers to exchange for goods and services, was provided in 
close proximity to the location of the reward and free of charge, which may have limited some 
of the barriers to meeting the contingency criteria. Future studies might optimize effectiveness of 
CM interventions by maximizing the value of the reward to the participant (i.e., individualizing 
rewards) and optimizing the response required by the participant to meet the contingency 
(i.e., minimizing MAT costs and transportation effort). 

Despite the demonstrated benefit of access to a workplace contingent upon taking naltrexone, 
these studies were small and were all conducted at one study site (in Baltimore, Maryland), 
raising concern for applicability to other settings. Further, such interventions may be difficult 
to implement in real-world settings due to cost, concerns that they may interfere with intrinsic 
motivation, and durability of effect.” 


Health IT 


We found very few published studies of IT interventions and no published evaluations of 
commercially available apps to improve MAT retention. Overall, studies reported no worse 
retention rates with IT approaches than with in-person approaches. Recognizing that there are 
few addiction specialists and counselors and that most are concentrated in urban areas, IT is 
promising for those with access to computers/internet, but questions remain on how to 
implement these programs at scale. The NIH NIDA Clinical Trials Network (CTN) study “Rural 
Expansion of Medication Treatment for Opioid Use Disorder” (CTN-102 Rural MOUD) plans to 
conduct an RCT evaluating the comparative effectiveness between office-based opioid treatment 
(OBOT) alone and OBOT plus telemedicine in highly impacted rural areas. The primary 
outcome is number of patient-days of buprenorphine treatment retention in the year following 
intervention implementation.”° 

Ongoing research is beginning to examine wearables and GPS monitoring capabilities to 
provide patients with increasing self-management and predictive analytics that can anticipate 
problems and offer real-time strategies and resources to avoid return to use. The AHRQ-funded 
project “Increasing Access to Medication-Assisted Treatment of Opioid Abuse in Rural Primary 
Care Practices” (https://integrationacademy.ahrq.gov/about/opioids-substance-use/ 
primary-care-medication-assisted-treatment-grantees) leverages smartphone apps, virtual 
training, telementoring, and consultations through Project Extensions for Community Healthcare 
Outcomes (Project ECHO) to support rural PC practices in five States in delivering MAT. The 
project started in 2016 and should have helpful data in the next few years. 

It is concerning that commercially available apps do not have published evaluations. Because 
IT interventions have undergone few trials and many of those are pilots, future research should 
focus on studies with long-term outcomes (beyond 3 months), with sample sizes adequate to 
demonstrate true equivalence, and with blinded outcome assessors. Such studies should consider 
potential harms as well as benefits and process issues (e.g., connectivity or software 
compatibility) for patients, clinicians, and clinical settings. 
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Extended-Release Medication-Based Treatment for OUD 


XR formulations are conceptually attractive to increase MAT retention because they do 
not require daily administration. One of the two XR medications available in the United States, 
XR-naltrexone, is a mu opioid receptor antagonist that provides long-lasting blockade of opioid 
receptors. The other, XR-buprenorphine, is an opioid receptor partial agonist that reduces 
withdrawal symptoms without decreased opioid tolerance. Unlike naltrexone, buprenorphine 
does not require a period of complete abstinence from opioids to initiate treatment and is used 
to manage acute opioid withdrawal and as long-term treatment of OUD. 

Similar to a prior review,°° we found inconsistent results for treatment retention with 
XR-naltrexone injection vs. daily MAT formulations. Our review also included recent studies 
that compared XR and daily buprenorphine that showed no statistically significant differences 
in retention between the two formulations.*2 +4 

The lack of studies comparing XR formulations head-to-head highlights the need for future 
comparative effectiveness trials that may change conclusions. We also identified study design 
issues related to patient selection, timing of randomization relative to completion of supervised 
withdrawal, and medically supervised withdrawal procedures that affected the study findings’ 
applicability and generalizability. Additional studies of XR-buprenorphine in real-world settings 
could be useful to address limitations of XR-naltrexone and other antagonist therapies that 
require a period of complete abstinence from opioids for treatment initiation. Future studies 
should also use treatment-based controls. 

Few studies in our review examined how participant characteristics affected retention, though 
there was evidence that those with lower opioid use severity or comorbid alcohol use were more 
likely to complete medically supervised opioid withdrawal and thus may benefit more from 
XR-naltrexone formulations.*” XR formulations could be particularly effective in some patient 
populations such as those at high risk of unforeseen treatment disruptions (such as homelessness 
or incarceration), those at risk for medication diversion and misuse, populations at risk for access 
disruptions or who live in remote areas, and those concerned about the stigma or inconvenience 
of daily maintenance therapy. Several ongoing trials may add to this evidence. For example, the 
NIH NIDA CTN “Retention-Duration-Discontinuation” trial (CTN-100 RDD Study) is currently 
in progress.’! This multisite, multi-arm trial enrolls 1,800 participants with OUD across 20 large 
outpatient OUD treatment clinics nationwide, provides the participants with a choice of 
buprenorphine or XR-naltrexone, and follows participants for 2 years, with MAT retention at 
6 months as the primary retention outcome.” It will assess the optimal duration and 
discontinuation of MAT. The results of these trials should help demonstrate whether long-acting 
formulations can improve retention outcomes. 


Psychosocial Support 


Our review of psychosocial support interventions (not including CM) largely aligns with 
the prior SR that found no effect on retention.'® The lack of observed differences between the 
experimental and control groups may be explained by the inclusion of psychosocial support in 
the control groups. Of note, eight of nine studies reviewed had control groups that received 
elements of psychosocial support through counseling,*” *4°° 12-step programs,”° self-help 
groups,*”*? or CM,°* and one study did not sufficiently describe their control.** Further, 
researchers could employ attention control groups (e.g., controls that receive an intervention that 
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mimics the amount of time and attention received by the treatment group but is not thought to 
exert effect) to reduce bias that may arise from participant awareness of assignment. 


Financial Support 


We did not find studies of financial interventions to improve MAT retention that met 
our inclusion criteria, suggesting an area for future study. We identified, however, studies 
of financial interventions that measured other outcomes that may give suggestions for future 
studies. A mixed-methods study involving stakeholder and focus group interviews examining 
the impact of out-of-pocket pharmacy costs on medication adherence identified out-of-pocket 
pharmacy costs for MAT as a barrier for continued treatment retention;’* another observational 
study evaluating the impact of Medicaid expansion of MAT coverage found reductions in opioid 
use—related healthcare utilization, but did not measure retention.’4 Similarly, a cohort time-series 
analysis of a dose-based prior authorization policy for buprenorphine by Massachusetts Medicaid 
found that the policy implementation led to increased treatment dropout and significant increases 
in relapse rates among those prescribed higher doses of buprenorphine.” 


Future Directions 


Our review provides opportunities to inform future research. First, there is a need for a 
standardized definition of MAT retention. While evidence suggests that retention in MAT may 
be key in improving OUD outcomes,** MAT retention was the primary outcome in fewer than 
half of the studies we reviewed. Definitions of retention varied widely, from number of days 
until dropout from study medication*® 7:27 3% 31; 3¢ 38.76 to proportion of participants remaining 
in treatment at 12 months;®*”? there was variability in how investigators assessed retention 
outcomes, and studies often were not clear in how retention was defined, making 
comparisons difficult. 

Ideally, a standardized definition of retention might have specified parameters around 
1) duration of participation in MAT, 2) degree of participation (e.g., if discontinuous, to what 
degree of discontinuity is acceptable), 3) and measurement of retention (e.g., urine screen for 
presence of MAT medication, patient self-report). 

Second, future research would benefit from study designs that improve applicability and 
generalizability. Future trials should enroll diverse groups of participants that are representative 
of the heterogeneous population of OUD patients and be conducted in a variety of practice 
settings to more closely resemble “real-world” conditions. Additionally, future studies should 
consider patient preferences for either agonist, partial agonist, or antagonist forms of MAT and 
design trials to allow for patient preference in assigning treatment. Some studies we reviewed 
were conducted outside of the United States, where policies and practices differ, limiting 
generalizability. 

In addition to improving generalizability, future studies would benefit from improved 
internal validity. While blinding of investigators and providers delivering MAT is generally 
not practical for most interventions, other methodological approaches such as blinding outcome 
assessors are almost always possible and should be performed. Large-scale ongoing 
implementation studies, such as the CTN-100 RDD study” that allows for patient preference 
and compares multiple retention strategies across a diverse array of real-world treatment settings, 
hold promise to inform clinical practice and public health policy. 
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Limitations of the Review 


Our review has several limitations. We were not able to review every intervention proposed 
to improve retention in MAT. Instead, we focused the scope of our review based on stakeholder 
input. We did not include non-RCT study designs, with few exceptions, and excluded RCTs that 
used placebo or non-MAT comparator groups, which required excluding studies of some 
interventions. We used a rapid review methodology, which involved searching limited databases, 
not conducting formal meta-analyses, and including findings from existing published SRs. 
Consistent with the rapid review standard practice, we used existing SRs to define the categories 
of interventions to include into our review. We did not conduct a formal assessment of 
strength-of-evidence assessment (e.g., publication bias assessment, differing tools for quality 
assessment), as we relied on the existing strength-of-evidence assessments provided within the 
included SRs. 

The interventions we reviewed were broad and diverse, which limited comparisons across 
studies. Further, we included only those studies that measured retention for at least 3 months. A 
3-month requirement was recommended by content experts as the minimum clinically relevant 
study duration to assess retention. Longer studies are needed to ascertain the sustained effects of 
various interventions on treatment retention; however. few studies identified in our search 
continued beyond 3 months. Finally, our review focused predominantly on the outcome of 
treatment retention. When considering healthcare or policy decisions, it would be important to 
consider other relevant outcomes, such as mortality and morbidity outcomes, access to treatment, 
as well as quality of life and other patient-centered outcomes. 


Conclusions 


In our review of the current evidence, we found few studies that assessed MAT retention as a 
primary outcome, and less evidence on harms of interventions and patient characteristics 
associated with differential effectiveness of the interventions. We found that retention in MAT 
may be improved through several avenues, including use of integrated care settings with criminal 
justice populations, and use of CM interventions for patients on antagonist MAT. Preliminary 
studies suggest that alternative means of care delivery (health IT) and integration of medical, 
psychiatric, and social services with MAT may not worsen retention outcomes. While the few 
comparative effectiveness studies to date show no difference in retention between XR 
formulations and SL daily formulations, this evidence is evolving. There are several areas for 
which future research is needed, given the paucity of controlled studies, including the use of IT 
interventions, telehealth-delivered MAT, and interventions to reduce the financial barriers to 
care. Overall, there is a critical need for better quality studies and explicit attention to harms as 
well as benefits. Because retention is associated with improved outcomes, future OUD research 
should develop standard measures for retention to be used in reporting results. 
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ivitrol or depot or "extended release" or implant or long-acting or "slow 


elease" or "sustained release" or XR-NTR).ti,ab, kf. 


((attend* or attrition or client* or clinic* or community* or group or office* or 

outpatient* or out-patient* or participant* or patient* or "primary care" or 

prison* or telemedicine or tele-medicine or telerehab* or tele-rehab*) adj15 

abstain* or abstinen* or adhere* or non-adhere* or nonadhere* or continu* 

or discontinu* or dropout* or drop-out* or engag* or longer or loss or lost or 
onth or months or no-show or recovery or reengag* or re-engag* or 


elaps* or retain* or retention or shorter or terminat* or (treatment adj2 


outcome”) or year or years)) or (access* or homeless* or housing or "social 


Services" or "social support*" or (Social adj2 (work or worker or workers)) or 


ransportation)).ti,ab,kf. 


A-3 


NIH RePORTer 

Additionally, because both health IT is rapidly expanding and opioids have been a focus of 
research funding, we also searched NIH RePORTer using advanced search using the terms: 
medication-assisted treatment” and mobile or telehealth, “Medication-assisted treatment” and 
opioid and retention, Medication-assisted treatment and opioids and smart phone, "medication- 
assisted therapy" and opioid and mhealth, “MAT" and opioid and mhealth, “MAT" and opioid 
and smart phone, and we searched NIH RePORTer Matchmaker using the following terms: 
opioid, medication-assisted treatment, MAT, medications for addiction treatment, Medication- 
assisted therapy, opioid, opioids, opioid use disorder, retention, retention, retention, smart phone, 
smartphone, app, telehealth, Mhealth, mhealth, mobile, IT, retention, retention on June 12,2019. 


Google Play Store 

A search of the Google Play store on May 18, 2019 searched the key terms “Opioid Use 
Disorder” “Medication Assisted Treatment” “Methadone” “Buprenorphine” and/or “Suboxone” 
to identify potential mobile applications (apps) aimed at increasing retention in MAT. To be 
included, the Google Play store app description needed to mention retention, be specific to OUD 
and MAT, and include some sort of interactive program (not be strictly informational). 
Descriptions of apps in the Google Play store were analyzed to determine key features of apps. 
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